Tuesday,  March  6.  2018 


Tuesday,  March  6  and  Wednesday,  March  7  sessions  will  take  place  at  the  Hilton  McLean  Tysons  Corner 
hotel.  Sessions  on  Thursday,  March  8  will  be  held  at  The  MITRE  Corporation 


Welcome  Remarks 

•  Gen  Hawk  Carlisle,  USAF  (Ret),  President  and  CEO,  NDIA 

•  Lt  Gen  Robert  Elder,  USAF  (Ret),  Chair,  NDIA  Cyber  and  Emerging  Technologies  Division 
International 

Keynote  Speaker 

•  Walter  O'Brien,  Founder,  Scorpion  Computer  Services  International  Ballroom  BC 

Panel  Session:  Decision  Support  Systems 

Moderator:  Dr.  Robert  E.  Schmidle,  Lt  Gen  USMC  (Ret),  Former  Deputy  Commander,  U.S.  Cyber 

Command 

•  Panelist:  Dr.  Jim  Gump,  Johns  Hopkins  University  Applied  Physics  Lab 

•  Panelist:  Bryan  Bartels,  Chief,  Future  Ops,  USSTRATCOM  Joint  Air  Component  Coordination 
Element  (JACCE) 

•  Panelist:  Dr.  Tony  Ng,  CTO  &  Solutions  Architect,  Civil  Transportation  Solutions,  Leidos 

•  Panelist:  Jeffrey  Gottschalk,  Leader,  Cyber  Systems  and  Operations  Group,  MIT  Lincoln 
Laboratory 

Panel  Session:  Artificial  Intelligence 

Moderator:  Lt  Gen  James  K.  "Kevin"  McLaughlin,  USAF  (Ret),  President,  McLaughlin  Global  Associates 

LLC 

•  Panelist:  Walter  O'Brien,  Founder,  Scorpion  Computer  Services 

•  Panelist:  Dr.  Edward  M.  Ochoa,  Lt  Col  USAF  (Ret),  Senior  Research  Engineer,  Machine  Learning 
and  Analytics,  Georgia  Tech  Research  Institute 

•  Panelist:  Dr.  Terry  Wilson,  Principal  Electronics  Engineer,  Air  Force  Research  Laboratory 

•  Panelist:  Kevin  Hall,  Distinguished  Engineer  (DE)  and  Cognitive  Solutions  Expert,  IBM  Defense 
and  Intelligence  Services 

Panel  Session:  Disruptive  Technologies:  Public/Private  Partnerships 

Moderator:  Dr.  Terry  Pierce,  Director,  Center  of  Innovation,  U.S.  Air  Force  Academy,  Special  Advisor  for 

DHS  Science  and  Technology 

•  Panelist:  James  Cole,  Senior  Director,  Security  Architecture  and  Strategic  Planning,  Intel 
Corporation 

•  Panelist:  Cherylene  Caddy,  Former  White  House  Director  for  Cyber  Policy  Integration  and 
Outreach 


•  Panelist:  Lt  Gen  Bradford  J.  Shwedo,  Chief,  Information  Dominance  and  Chief  Information 
Officer,  Office  of  the  Secretary  of  the  Air  Force 

•  Panelist:  Jason  Upchurch,  Computer  Security  Architect,  Intel  Corporation 

•  Panelist:  C1C  Dane  Hankamer,  U.S.  Air  Force  Academy 

Panel  Session:  Delivering  Value  as  a  Small  Business 

Moderator:  Ken  Loy,  Chair,  NDIA  C4ISR  Committee 

•  Panelist:  ML  Mackey,  CEO,  Beacon  Interactive  Systems 

•  Panelist:  Tom  Weithman,  Managing  Director  and  Vice  President,  Center  for  Innovative 
Technology 

•  Panelist:  Dr.  Ellen  Ferraro,  Director,  Research  and  Technology,  Integrated  Defense  Systems, 
Raytheon  Company 


Wednesday,  March  7,  2018 


Admin  Remarks 

•  Lt  Gen  Robert  Elder,  USAF  (Ret),  Chair,  NDIA  Cyber  and  Emerging  Technologies  Division 

Keynote  Speaker 

•  Gen  Stephen  W.  Wilson,  USAF,  Vice  Chief  of  Staff,  U.S.  Air  Force 

Panel  Session:  Augmented  Reality 

Moderator:  Lauren  Flamburg,  Augmented  Reality  Business  Development  Lead,  Newport  News 
Shipbuilding 

•  Panelist:  Jason  Ingalls,  CEO,  Ingalls  Information  Security 

•  Panelist:  Paul  Davies,  Electrical  Engineer,  Project  Manager,  &  Associate  Technical  Fellow,  The 
Boeing  Company 

•  Panelist:  Frank  Serna,  Director,  Draper  Laboratories 

•  Panelist:  Joshua  Burns,  Simulations  Engineer  and  Augmented  Reality  Subject  Matter  Expert, 
Floneywell 

Panel  Session:  Cyber-Human  Systems 

Moderator:  Maj  Gen  Jim  Keffer,  USAF  (Ret),  Director  Cyber,  Lockheed  Martin 

•  Panelist:  Kevin  Yin,  CEO,  SitScape,  Inc. 

•  Panelist:  Dr.  James  Kilbride,  Director  of  Augmented  Reality,  General  Dynamics  Mission  Systems 

•  Panelist:  Dr.  Robert  Floffman,  Senior  Research  Scientist,  Institute  for  Fluman  &  Machine 
Cognition 

•  Panelist:  Dr.  William  Casebeer,  USAF  (Ret),  Senior  Manager,  Fluman  Systems  and  Autonomy, 
Lockheed  Martin 


•  Panelist:  Col  William  D.  Bryant,  USAF,  Deputy  Chief  Information  Security  Officer  for  Mission 
Assurance,  Office  of  Information  Dominance  and  Chief  Information  Officer,  Secretary  of  the  Air 
Force 

Lunch  &  Interactive  Speaker  -  "Ask  Scorpion" 

•  Walter  O'Brien,  Founder,  Scorpion  Computer  Services 


Panel  Session:  Virtual  Training  Systems 

Moderator:  RADM  James  A.  Robb,  USN  (Ret),  President,  National  Training  and  Simulation  Association 

•  Panelist:  Walter  O'Brien,  Founder,  Scorpion  Computer  Services 

•  Panelist:  Paul  Biegel,  Program  Manager,  Interactive  Simulations,  The  Johns  Hopkins  University 
Applied  Physics  Laboratory 

•  Panelist:  Jeff  Fisher,  Virtual  Reality  Lab  Manager,  National  Institute  for  Aviation  Research, 
Wichita  State  University 

•  Panelist:  Eric  Spalding,  Advanced  Technology  Lead,  The  Boeing  Company 

Panel  Session:  Physical  System  Replication 

Moderator:  Lt  Gen  Robert  Elder,  USAF  (Ret),  Chair,  NDIA  Cyber  and  Emerging  Technologies  Division 

•  Panelist:  William  Cave,  CEO,  Prediction  Systems  Inc. 

•  Panelist:  Dr.  John  J.  Kelly  III,  President,  Model  Software  Corporation 

•  Panelist:  Philomena  Zimmerman,  Deputy  Director  for  Engineering  Tools  and  Environments, 
ODASD(SE) 

•  Panelist:  Dr.  Sridhar  Lakshmanan,  Associate  Professor,  Electrical  and  Computer  Engineering, 
University  of  Michigan-Dearborn 

Keynote  Speaker 

•  Chris  Inglis,  Managing  Director,  Paladin  Capital  Group 

Closing  Remarks 

•  Lt  Gen  Robert  Elder,  USAF  (Ret),  Chair,  NDIA  Cyber  and  Emerging  Technologies  Division 


GAP  CIE  Brief  to  the  NDIA 
Capabilities  for  Senior 
Decision  Makers  Panel 


•  A  web  based  application  using  common  enterprise  services  and 
joint  planning  processes  to  provide  a  joint  planning  and  situation 
awareness  application  with  shareable  information  for 
simultaneous  use  by  multiple  Services,  Commands,  Agencies, 
Allies  and  Organizations 

•  GAP  CIE  is  an  operational  application  that  was  developed  to 
orchestrate  the  Joint  Planning  Process  (JPP)  and  is  the 
Department  of  Defense  (DoD)  Program  of  Record  for  Joint 
Strategic  Course  of  Action  (CO  A)  Development 

•  Resides  on  JWICS,  SIPRNet,  and  SIPR-Rel  (USA,  AUS,  CAN, 
GBR,  and  NZL)  enclaves,  allowing  staffs  to  include  Allied 
partners  in  planning  and  sharing  of  situational  awareness 


Slide  2 


Importance  to  Senior  Leaders 

■  ii 

•  GAP  CIE  provides  the  visualization  of  data  via  three  main 
outputs;  briefings,  documents  and  dashboards 

•  Dashboards  provide  the  user  the  capability  to  simply  and 
effectively  display  data 

•  Dashboard  content  is  completely  user  configurable  and  displays 
specific  data  and  data  types  required  to  provide  Senior  Leaders 
with  near  real-time  Situational  Awareness 

•  Data  sources  include  information  from  various  Portlet  records 
within  the  GAP  CIE  workspaces  and  authoritative  external 
sources  and  websites  via  the  Global  Situational  Awareness  Tool 
(GSAT) 

•  Distributed,  collaborative  planning  enabling  time  sensitive  vs. 
time  consuming  serial  planning 
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Global  Adaptive  Planning  Collaborative  Information 

Environment  (GAP  CIE) 
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Nuclear  Planning 


Maritime 

Forces 


Common  Data  Schemas, 
Vocabulary  and  Service  Level 
Agreements 


Federated  &  Synchronized 
Data  at  Multiple  Nodes 


Net-enabled  Enterprise 
Services 


Operation  Planning 
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Web-Services 


Web-Services 


Net-centric  access  to 
operational  and  tactical 
planning  systems  for 
information  exchange 


Web-service  product 
support  to  the 
Enterprise 


Crisis  Action  Planning 
Conventional  Target  Weaponeering 


COA  Development 
Effects  Planning  &  Assessment 
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Joint  Planning  Process  (JPP) 
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What  does  GAP  CIE  DO? 


Problem:  No  Machine-to-Machine  or 
application-enhanced  collaboration; 
just  white  boards  and  PowerPoint. 
Bottom  Line:  It  takes  too  long  to 

develop  complex,  integrated,  and 

resource-constrained  plans. 


I  I 

GAP  CIE  Solution;  Machine-to-Machine  collaboration  via  a  common  C2  application  with  access  to  and  orchestration 
of  authoritative  data  to  deliver  a  process  structured-CDR  centric-User  driven  planning  capability.  Conceptually,  the 
application  "Folds"  the  JPP  through  parallel,  integrated  planning  workspaces  to  couple  the  work  of  the  J3  and  J5  (plus  J2 
Intel  &  support  staff)  within  an  organization  and  also  among  different  organizations. 

~Y~ 

Time  Saved 


Don't  change 
the  process; 
change  how 
you  execute 
it! 


Time-Parallel 

Process 


GAP  CIE  enables  Planners  of  all 
experience  levels  to  create  more 
options  of  better  quality;  faster 


Plus  SA, 
Orders,  JIPOE 
(J2  Intel)  & 
Authoritative 
Data  Enablers 


Integrated  Planning  among 
multiple  CCDRs,  JTFs,  Allies  and 
Coalition  partners  with  User 
defined  Access  Controls 


Modernizing  the  Legacy  Application 


•  GAP  CIE  2.0  (GC2)  is  a  wholesale  transformation  vs  legacy  GAP  CIE 

-  Improved  user  interface 

-  Easier  to  use  and  train 

-  User  defined  planning  provides  flexibility  and  much  greater  capability 

-  Reduced  software  modification  costs 

-  Deployments  of  new  code  require  mere  minutes  vs  hours 

-  60%  more  cost  efficient  to  sustain 

•  System  automatically  gives  your  data  structure  and  semantic  meaning 

•  Output  types  include:  Briefings,  Documents  and  Dashboards 

•  Briefings  and  Documents  can  be  exported  to  MS  Office  equivalents  or  as  an 
XML  file  for  consumption  by  other  programs 


Decision  Support 


An  ArchMeclwre  for  AkiIo  Systemi  Lnainc  crlnu 
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Dr.  Jim  Gump 
Jim.gump@jhuapl.edu 
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Introduction: 

Government  Developed  vs  COTS 


Secure  Mobile  Environment  Portable 
Electronic  Device  (SME  PED) 


Latest  Commercial  Tech 
(Secured  with  Commercial 
Encryption) 


Earpiece  *  *  CAC  Reader 


Vibrating  Ringer 

Interchangeable  Wireless 
Module  (GSM/CDMA/Wi-Fi} 

Color  Touchscreen  Display 
Volume  Keys 
Application  Launch  Keys 
Send  Key 
Phone  Dial  Pad 
Speaker 
QWERTY  Keyboard 
Unclassified  USD  Port 

Unclassified  PDA 

External  Power  Jack 


Docking 

Connector 


SCIF  Friendly  Key 

■  Stylus 

+  SCIE  Alert  and  Unlocked  LEDs 
Mute  Key 

5-Way  Navigation  Key 
End/Power  Key 

•  Removable  Battery 

*  microSD  Flash  Card  Slot  lunder  battery) 

Classified  Serial  Port  IDS-101  Fill/Data/ 
Software  Update) 

Classified  USB  Port 

Classified  PDA  Key 

*  Headset  Jack 


Microphone 


Trusted  Display 


Years  to  Develop,  Obsolete  when  fielded . . . 


Introduction 

New  Paradigm  for  Encryption  "Devices"  (derived  from  NSA  MACP) 


Enterprise/  RED 
Network 


I  v  j  Traditional  Encryption 


NIAPP  Protection  Profiles  (Vendor 
Products) 

NIST  Risk  Management  Framework  (RMF)  -  All 
_ Systems 

Mobile  Access  Capability  Package  Ver  .8,  National  Security 
Agency  (NSA) 


COTS 
Monitoring 
(Cyber  tools) 


Typical  Government  (NSA)  Developed  Encryption  (mil  spec .  box) 
Replaced  by  Commercial  IT  -  VPN  Tunnel  inside  another  Tunnel 


Combination  Lock  Analogy 
("Dial"  a  Configuration) 


User  Equipment  Access  Mobility  Infrastructure 

Networks  and  Enterprise  Services 


“Back-end” 

Interconnect 
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Access  to 
Decision 
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Operational  Viewpoint 

A  Sampling  of  Transport  Alternatives 


End-User- 
Device  (s) 
(EUDs) 


Government  Netwojj^ 
Public  Network 


What  Transport  is 
Required? 


Government  Network 
Public  Network 


Hot 

Spot 


Public  Cell  Networks 
Or  Government  Cell  Networks  (Tactical! 
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Direction  for  Solution 
Developer 


Vehicle 
Cell  Kit 


Landing  Zones 
To  get  to 


Government  Network 


Public  Network 

Government  Network 
Public  Network 


SATCOM 


Don’t  forget  the  Threat  -  Signal  Intercept,  Cyber,  etc  (Risk) 

Explore  all  the  Alternatives  and  Consider  Risk  to  Each  and 
Locations  Required  will  Drive  the  Transport  Options 


Architecture  Foundation 
High  Level  Requirements  &  Associated  Risk 
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4.  Location(s) 

•  Aircraft,  Vehicle,  on  foot,  etc 

•  Government  and/or  Commercial 

•  US  and/or  OCONUS 


omposed 
Solution: 


Risk  “Volume” 
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1.  User(s)  &  Required  Applications 

•  Senior  Leader,  Comms  Officers,  etc 

•  Voice,  Video,  Email,  C2,  BA,  etc 


Location 

International 

<■ 


Risk  -  Volume 


Enterprise  Extended 

FOUOX  Secret  Top  ^ 

Secret  V  sli 


Notional 

Construct 


Cellular 


Public 
I  WIFI 

Device  -  Access 
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2.  Enterprise  Extended 

•  Enterprise  unclass.  Secret, 
TS/SCI,  etc 

*  Services  available 


3.  Device(s)  &  Transport 

•  Phone,  Tablets,  Laptops,  etc 

•  w/  WIFI,  Cellular,  etc  '5^* 
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Using  the  High  Level  Requirements  the  Risk  can  be  Illustrated  as 

" Volume ” 


Operational  Viewpoint  -  End  User  Capabilities 


Required 

EUDs? 


Direction  for 

Solution 

Developer 


-and/or  - 


^  Command  and  Control 

Enterprise  Services  Applications 


Secure  Phone 


Secure  VTC 


Secure  Email 


Classification 

Level? 


Streaming  Video 


C2  Applications  available 
in  fixed  Locations 


Other  C2  Aps  - 
Tracking  Phones  etc 


Required 
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Bringing  Secure/Classified  Communications  to  the  end  user  on-the-move 

(all  locations)  using  all  commercial  Technology 


Reference  Architecture  or 
Technical  Patterns  (for  family  of  solutions) 


Architecture  Frameworks 

(DODAF,  etc) 


Reference  Architecture 

Or  Technical  Pattern 
(for  a  specific  application) 


Solution  Architecture/ 

Solution  Space 

(for  specific  application) 


Reference  Architectures  can 
be  formatted  using  a 
specific  architecture 
framework  (speeds  solution 
architecture  development) 


Optimally  constrained 
solution  space 


ooo 


All  Architectures  are  not  the  same  -  Use  Framework ,  Solution ,  Reference , 
Enterprise  Arch .  with  Caution  -  Each  are  Defined  and  Use  will  Vary 
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Artificial  Intelligence 

and  Cognitive  Computing 


Kevin  Hall 

IBM  Distinguished 
Engineer 


US  Defense  and 
Intelligence  Services 

03/06/2018 


Outline 


*  Al  and  "Cognitive  Computing" 

*  Status  and  Usage 

*  Applicability  for  DoD  of  On-Premise  Cognitive/AI 

•  Critical  Criteria  for  Selecting  Al/Cognitive  for  DoD 

*  Adoption  and  Ethical  Aspects  of  Al  /  Cognitive 


IBM  View  of  Al  and  “Cognitive  Computing” 


1. 

Understands 


Generates  and 
evaluates 

evidence- based 
hypothesis 


Understands 

natural  language 

and  human  style 
communication 


2.  Reasons 


q  Adapts  and  learns 

^  from  training, 
interaction,  and 
outcomes 
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3. Learns 


The  Al... 

•  Understands  me 

•  Engages  me 

•  Learns  &  improves  over  time 

•  Helps  me  discover 

•  Establishes  trust 

•  Has  endless  capacity  for  insight 

•  Operates  in  a  timely  fashion 


What  makes  Al  offerings  different ? 

•  Understanding:  Speech,  text,  data,  images 

•  Reasoning:  Patterns,  Neural,  Deep 

•  Learning:  Trained,  Supervised,  Unsupervised, 
Challenge-driven 

•  Outputs:  On-screen,  voice,  actions  3 

•  Deployment:  Embedded,  augmented,  stand-alone 


Cognitive  Principles 


*  Better  data  =  better  outcomes 


Training  >  Programming 


Al  anxiety?...  Think  IA  (Intelligent  Assistant) 

•  Ingest  much  more  information 

•  Make  additional  observations 

•  See  non-obvious  relationships;  removal  of  bias 

•  Perform  repetitive  and  boring  tasks 
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Status:  How  did  we  get  here? 


•  IT  Technology  Evolution: 

•  Data  growing  faster  than  processing,  disk  I/O.  networking 

•  So,  more  data  exists  than  can  be  used ...  in  time. 

•  Result:  Data-centric  systems  that  minimize  data  movement 

•  Overall  Technology  Evolution: 

•  Exponentially  growing  tech  converges,  disrupting  industries 

•  Computing,  Robotics,  Sensors,  Al,  Communications,  Mobile 

•  Systems  Evolution: 


Telecommunications, 

$696.40 


Usage:  Where  is  the  Spending  on  Al? 

Worldwide  Cognitive  /  Al  Spending  by  Industry 
(2018  forecast,  $M) 

[ansportation,  $567.90  Utilities,  $327.10 


State/local 

government. 

Securities  an^f?&$Rment 
services,  $1,038.90 


Retail,  $2,907.30 


Professional 
services,  $226.00 

Process  manufacturing, 
$850.50 

Insurance,  $490.50 


Healthcare  provider, 
$2,082.80 


Source:  IDC's  Worldwide  Semiannual  Cognitive/Artificial  Intelligence 
Systems  Spending  Guide  1  HI 6,  2017 


Banking,  $3,922.60 


Cross  industries,  $1,906.10 


VFederal/central 
government,  $368.10 


\ 


Discrete  manufacturing, 
$2,360.90 


.Education, 

$295.40 


Projected  2-yr  Growth: 

Average:  232% 
Fed/Gov:  1 64%  6 


Usage:  Where  is  Al  being  used  Every  Day? 


Very  Common 

-  Voice  Assistants 

-  Chatbots 

-  Social  Media 
-GPS 

-  Commercial  air  travel 

-  Music  Streaming 

-  Drones 

-  Taxes 

-  Order  fulfillment 

-  Advertising  /  shopping 

-  Customer  Advisors 


Specialties 

-  Medical  diagnosis  (oncology) 

-  Alcohol  production 

-  Farming 

-  Energy  optimization 

-  Logistics 

-  Image  processing 

-  Business  Analytics 

-  Art  (movie  trailers,  books) 

-  People  matching 

-  Weather  forecasting 

-  Hyper-Local  Marketing 
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Usage:  “Local”  /  Specific  Al 


■  ’  oefcvery" 

new.-«p*»- 


r::£LT^mail 

it&y  d«hv«ry  informed 


Healthcare  (oncology) 

Data  Mining/Discovery 

Chat  hots 

Personnel 

Finance 

Sourcing 

"Automation" 

Geospatial 

Social  Media  Extraction 


Plant  Advisor 
Business  Foresight 
Process  Automation 
Customer  Care 
Video  Processing 
Audio  Processing 
Causation  Models 
Tutors 

Cyber  Security 
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Applicability  for  DoD  of  On-Premise  Cognitive/AI 


•  Fleet  /  Forces  Readiness  and  Maintenance 

•  Imagery/Video  Exploration,  Recognition,  Extraction 

•  Cognitive  Situational  Understanding 

•  Cybersecurity 

•  Social  Media  Data  Mining 

•  Virtual  Advisor  /  Conversation  Services  (Chatbots) 

•  Data  Mining/Exploration  (search  &  content  analytics) 

•  Business  Decision  Support  ( various ) 


Critical  Criteria  for  Selecting  Al/Cognitive  for  DoD 


*  Functional 

•  Cognitive  and  Processing  Dimensions 

•  Understand,  Reason,  Learn 

•  NLP,  Analytics,  Geospatial,  Data  Management,  Predictive/COAs 

•  Inputs 

•  Text,  Data,  Multimedia,  Social,  Cyber,  Sensors,  Events,  Legacy 

•  Outputs 

•  Screen,  Audio,  Robotics,  IT  Action,  Event  Transmission,  Geospatial,... 

*  Co-Existence 

•  Integration  (in/out) 

•  Migration  Potential  (in/out) 

•  Pre-Requisites  (software,  licensing,  data,  rights) 

*  Deployment 

•  Hosting  Needs:  Local/DIL  vs.  On-Premise  vs.  Cloud 

•  NFRs:  Security/RMF,  Scalability,  Admin  Needs,  Extensibility 

•  Costs:  Skills,  Services,  Software,  Training,  etc. 
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Top  Adoption  and  Ethical  Aspects  of  Al  /  Cognitive 


•  Purpose 

•  Question :  Should  Al  obta in  consciousness  or  independence? 

•  Ethical  Al:  Augment  human  capability.  Do  this: 

•  Extend  human  capability,  expertise  and  potential 

•  Embed  in  human-controlled  processes,  systems,  products,  services 

•  Transparency 

•  Question :  Should  we  have  confidence  in  Al's 
recommendations,  judgments  and  uses? 

•  Ethical  Al:  Make  Al  reasoning  and  training  transparent.  Make 
clear: 

•  Usage:  When  and  why  Al  is  being  applied 

•  Training:  What  data,  expertise,  and  methods  trained  the  Al 

•  Rights:  Our  clients  own  their  own  models,  IP,  and  data 

•  Skills 

•  Question:  How  do  we  factor  the  human's  skills  affected  by  Al? 

•  Ethical  Al:  Help  people  acquire  new  skills  and  knowledge  to 
engage  with  Al  systems,  and  perform  new  kinds  of  worxthat 
emerge. 


https://www.ibm.com/blogs/think/2017/01/ibm-cognitive-principles/ 
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So,  Our  Priorities  for  Al  Adoption  and  Ethics 


•  Purpose:  human  augmentation  versus  replacement 

•  Human  decision-making 

•  Human  judgement,  morals  and  intuition 

•  Transparency  in  training,  data,  reasoning,  &  sources 

•  Clear  inferences 

•  Sources  and  reasoning 

•  Protection  of  data  and  rights 

•  Skills  training  and  education 

•  There  is  a  shortage  of  workers  with  the  skills  needed  to 
work  in  partnership  with  Al  systems 

•  Emphasize  skills  rather  than  degrees 


https://www.ibm.com/blogs/policy/kenny-artificial-intelligence-letter/ 
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Backups 
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Al  Glossary 


Artificial  Intelligence  -  Any  technique  that  enables  computers  to  mimic  human 
intelligence  (warfighter  intelligence),  using  logic,  if-then  rules,  decision  trees  and 
machine  learning  to  support  the  warfighter. 

Machine  Learning  (ML)  -  The  subset  of  Al  that  includes  statistical  techniques  that 
enable  machines  to  improve  at  tasks  with  experience.  Machine  Adaptation  to  the 
Army  warfighter. 

Deep  Learning  (DL)  -  The  subset  of  ML  composed  of  algorithms  that  permit  software 
to  train  itself  to  perform  tasks  in  support  of  the  warfighter  functions.  Like  speech 
(language  detection,  language  translation,  voice  to  text,  text  to  voice  Al  services), 
image  &  visual  recognition  (digital  imagery,  digital  video),  by  exposing  multi  layered 
neural  networks  to  vast  amounts  of  big  data  on  the  asymmetric  battlefields  of  the 
future. 

Neural  Networks  /  Neural  Nets  (NNs)  -  Virtual  software  constructions  modeled  after 
the  way  adaptable  networks  of  neurons  in  the  brain  are  understood  to  work,  rather 
than  through  rigid  instructions  predetermined  by  humans. 

Natural  Language  Processing  (NLP)  -  The  computer  processing  that  takes  place  in 
speech-recognition  technology,  in  which  software  is  able  to  recognize  spoken 
sentences  and  is  able  to  re-create  spoken  language  into  text. 
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Cognitive  systems  rely  on  collections  of  data 
and  information... 


C 

...and  then  leverage 
IBM  Watson  APIs  to 
apply  cognitive 
capabilities. 


50  underlying  technologies 


Entity  Extraction 
SentimentAnalysis 
Emotion  Analysis  (Beta) 
Keyword  Extraction 
ConceptTagging 
Taxonomy  Classification 
Author  Extraction 
Language  Detection 
Text  Extraction 
Micro  formats  Parsing 
Feed  Detection 
Linked  Data  Support 
Concept  Expansion 
Concept  Insights 
Dialog 

Document  Conversion 
Language  Translation 


Natural  Language  Classifier 
Personality  insights 
Relationship  Extraction 
Retrieve  and  Rank 
Tone  Analyzer 
Emotive  Speech  to  Text 
Text  to  Speech 
Face  Detection 
Image  Link  Extraction 
Image  Tagging 
Text  Detection 
Visual  Insights 
Visual  Recognition 
AlchemyData  News 
Tradeoff  Analytics 


Retrieve  and  Rank 


Cognitive  Systems:  IBM  brings  the  power  a  holistic 
cognitive  analytics  ecosystem  to  address  these  specific  needs 


Business 

Outcomes 


COGNITIVE 

ENGAGEMENT 


Cognitive: 
search, 
analyse, 
reason  &  learn 


COLLECTIVE 

INTELLIGENCE 


Data 

Analytics 


Integration  &  Data 
Governance 


SYSTEMS  OF 
RECORD 

Structured  data 


CORPUS  OF 
RECORDS 

Content 


Al  in  Popular  US/English  Movies 


Creation  Date 

Movie  title 

The  Artificial  Intelligence... 

Country 

1921 

Mechanical  Man 

...  commits  crime  acts.,  following  human  directions 

Italy 

1927 

Metropolis 

...  obeys  her/its  creator's  command  to  cause  chaos 

Germany 

1936 

Undersea  Kingdom 

...  kills  enemies  as  remote  controlled  fighting  robots 

US 

1939 

The  Phantom  Creeps 

...  intends  to  destroy  the  human  race 

US 

1941 

The  Mechanical  Monsters 

...  commits  crimes  and  destroys 

US 

1954 

Gog 

...  destroys  and  kills  people 

US 

1957 

Kronos 

...  fights  to  harvest  all  forms  of  energy  for  an  alien  race 

US 

1961 

Invasion  of  The  Neptune  Men 

...  intends  to  obsess  the  Earth  to  destroy  the  human  race 

Japan 

1963 

A  Space  Odyssey 

...  due  to  a  malfunction  kills  the  spaceship  crew  to  defend  itself 

US 

1977 

Star  Wars 

...  helps  people  in  general  (C3PO  and  R2D2) 

US 

1930 

DA.R.Y.L. 

...  looks  as  a  10-year-old  hoy,  a  supercomputer  with  human  feelings 

US 

1982 

Blade  Runner 

...serves  mankind  as  short-life  "replicants"  but  seeks  for  freedom 

US  -  Austral 

1984 

Terminator 

...  comes  back  from  the  future  to  change  history  by  killing  a  human 

US- UK 

1986 

Short  Circuit 

...  is  a  military  robot  with  a  sense  of  free  will 

US 

1987 

RoboCop. 

...  servs  and  protects  humanity,  fights  crime 

US 

1991 

Terminator  2  -Judgement  Day 

...  comes  back  from  the  future  to  change  history  by  killing  a  human 

US-F  ranee 

1999 

The  Matrix 

...  keeps  mankind  in  slavery,  locking  them  in  a  simu  ated  reality  world 

US  -  Austral 

2001 

A.I .  Art  ifi  cia  1 1  nt  e  1 1  ige  nee  " 

...  intends  to  get  back  to  its  human  "mother" 

US 

2003 

Terminator  3  -  The  Rise  of  the  Machines 

...  comes  back  from  the  future  to  change  history  by  killing  a  human 

US-German 

2004 

1,  Robot 

...intends  tofree-up  robotic  race  from  human  oppression 

US 

2005 

The  Hitchhiker's  Guide  to  the  Galaxy 

. is  paranoid  and  depressed  that  they  cannot  use  their  planet-size  brain  :) 

UK- US 

2003 

Wall-E 

...  falls  in  love  while  cleaning  up  the  post-apocaliptic  planet  Earth 

US 

2009 

Terminator  -  Salvation 

...  thinks,  feels,  acts  like  a  human  -  and  sacrifices  himself  for  humans 

US-German-ltalian 

2013 

The  Machine 

...  created  as  super-soldier  but  becomes  more  human  than  its  creators 

UK 

2014 

Automata 

...  intends  to  ensure  the  robotic  race  evolution 

Spain-Bulgaria 

2015 

Ex  Machine 

...  succeeds  a  Turing-test,  fa  is  in  love  with  a  human  and  escapes 

UK 
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IBM  Watson 


The  Overall  Global  IT  Outlook  is  toward  Understanding 


Understanding 

the 

World 


Automating 

the 

World 


Genomics 
Social  Networks 
Security 


Graph 

Analytics 


Moore’s  Law 


Haswell  2X2  (22nm) 

MOM  Tranilttora 


Healthcare 
Education 
Internet  of  Things 


Machine 

Learning 


35% 

More 

Transistors 


37% 

Smaller 


Broadwell  2X2  (14nm) 

1 JB  transistors 


Broadwell  delivers: 


Video, 

Speech 

Analytics 


Object  recognition 
Complex  video  analytics 
Multi-model  analytics 


2.2x  increase  in  transistor  density 


Up  to  40%  better  3D  graphics  perf 


Enables  <9mm  fanless  designs 


Source:  IBM  Global  Technology  Outlook,  Jan  2016 
IBM  Research:  Foundations  for  Cognitive  Business 


Cognitive  Computing 


•  A  cognitive  system  is  not  programmed.  It  gathers  data, 
makes  observations,  and  learns  through  experience. 

•  Pragmatic  Artificial  Intelligence  (Cognitive  Computing) 
enhances  our  ability 

•  Specific  task 

•  Stated  and  measurable  goal  /  success  criteria 

•  A  smart  agent  that  helps  you  achieve  that  success 

•  Example:  Advanced  Automotive  Technology. 

•  You  have  2  eyes;  your  car  may  have  ~100 


Source:  Motortrend  Source:  JDPowers 


Al  from  the  Cloud  -  1  of  3 


Personality  Insights  API 


TWEETS  FOU.OWKG  FOLLOWERS  FAVORITES 


ahid 


599 

512  111 

43 

Tweets 

Tweets  &  replies 

Photos  &  videos 

Q  QaouOAt 

jou  Chafiid  retoeeled 

Cl  Abu  Langer  4 

■Li^Ces  Kouffars  ne  se  sont  pas  encore  rendus  compte  qu'iis  se  sont  trompes 

The  Personality  Insights  service  derives 
insights  about  personality  characteristics  from 
social  media,  enterprise  data,  or  other  digital 
communications. 
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Al  from  the  Cloud  -  2 

Visual  Recognition  API 
(Object  Classifier) 

The  Visual  Recognition  Service  finds 
meaning  in  visual  content!  Analyze 
images  for  scenes,  objects,  faces, 
and  other  content. 


of  3 

Visual  Recognition  API 
(Facial  Recognition) 

The  Visual  Recognition  Service 
finds  meaning  in  visual  content! 
Analyze  large  volumes  of 
unstructured  data  to  conduct 
facial  recognition  through 
machine  learning. 
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Al  from  the  Cloud  -  3  of  3 


Language  Translator  API 

The  Language  Translator  Service 

dynamically  translate  news,  patents,  or 
conversational  documents?  Instantly  publish 
content  in  multiple  languages?  Supported 
languages  include: 

Afrikaans,  Albanian,  Arabic,  Azerbaijani,  Bashkir, 
Belarusian,  Bulgarian,  Bengali,  Bosnian,  Chinese, 
Traditional  Chinese,  Czech,  Chuvash,  Danish,  Dutch, 
German,  Greek,  English,  Esperanto,  Spanish,  Estonian, 
Basque,  Farsi/Persian,  Finnish,  French,  Gujarati,  Hebrew, 
Hindi,  Haitian,  Hungarian,  Armenian,  Indonesian, 
Icelandic,  Italian,  Japanese,  Georgian,  Kazakh,  Central 
Khmer,  Korean,  Kurdish,  Kirghiz,  Lithuanian,  Latvian, 
Malayalam,  Mongolian. 


Text  to  Voice  API 
Voice  to  Text  API 


The  Text  to  Voice  API  processes 
text  and  natural  language  to 
generate  synthesized  audio 
output  complete  with 
appropriate  cadence  and 
intonation.  It  is  available  in 
several  voices. 
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Top  Ethical  Issues  with  Al  /  Cognitive 


1.  Should  Al  obtain  consciousness  or  independence? 

•  At  issue:  Autonomous  systems  (e.g.  self-driving  cars) 

2.  Should  we  have  confidence  in  Al's  recommendations, 
judgments  and  uses? 

•  At  issue:  Trusted  systems  (e.g.  medical  diagnosis). 

3.  How  do  we  factor  the  human's  skills  affected  by  Al? 

•  At  issue:  Human-system  relationship  (e.g.  robotics) 

4.  Should  we  allow  any  use  of  the  results? 

•  At  issue:  Usage  rights  (e.g.  genomics  data  used  for 
discrimination) 
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HQ  U.S.  Air  Force  Academy 


Integrity  -  Service  -  Excellence 


Facebook  Summer  Research: 
Al  Chatbot  Technology 


UNITED  STATES 

AIR  FORCE 
ACADEMY 


DHS  Center  of  Innovation 
C1C  Dane  Hankamer 


What  is  an  Al  chatbot? 


Aj? 

UNITED  STATES 

AIR  FORCE 
ACADEMY 


heroku 


••••O  AT&T  2:46  PM 

Cadet  Life  Bol 

Block 

If  Mitches  was  open  to 

the  public,  my 

calculations  show  it 
would  receive  4.5  star 
reviews.  Which  meal 
are  you  inquiring 
about? 

Breakfast 

Lunch 

Dinner 


Main  Menu 


Think  'App',  except  you  are  texting  a  robot  that  performs  tasks 


Integrity  -  Service  -  Excellence 


2 


Cadet  Life  Bot 


Aj? 

UNITED  STATES 

AIR  FORCE 
ACADEMY 


■  Problem  Solved  for  Cadets! 

■  Timely  process  to  open  OPORD 

■  Bot  stores  daily  meal,  briefing  and 


uniform  information 


Information  is  now  at  cadets'  fingertips 
in  Facebook  Messenger 


HOD:  ABtJs 

Mostly  Sunny.  High  68°.  Low 
46° 


Rcvtdk  0-00  Hap' i:  Clos'd 

Tjpr  0130  Oont  111:  (TJO 1630 

Gym  0530:200  Pool  (*on  i«viMF 

ORC-Wnim*  Outer  Pobre  Htfl  CQ:  Ctowd 

<  W.M _ 

Matey 

•  Pin  n  requard  when  at  the  CfC  brt*r*n  the  Hum  of  0700  and  H45  op»  wwWjyv  rill 
l ISA! A  AJhlHu:  Ofar.  o,  IM  (lump  T  Shut  wHhPTU  ro  wnrk*«Jv 

•  UOOkieqafrtd  on  the  T70  and  la  M4ch*l  h*a  Sam  0736 1M0 

•  Men*  mtm«  UC  Uwun  Uh  tor  any  m’unMtkut  needed  on  the  tto<*  tobewntout 

•  fet  <1  toil  Ml  few«4  Harm,  Ml  taMkd 

•  W«cM<w^W(«i  wwwh  Iwidutfl  ilnyi 


Military  Duties 


CMRcat  c4  Km  Dwr  "tsl  ( ;i'woi  <m/>) « <;t<>  t  W  OVI11 

Caen  Wke  OparitMm UnM:  /!•»  1  1  WHO 
CWO<  (0n%<**<  On  am  l  AiMry  WndrySOl  V*41/» 
W.Ktenily  lAMVfll  ImA  V 
Ap+eOvrd  fty  </CotUu««M  V* 


Integrity  -  Service  -  Excellence 
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Innovative  Counterintelligence 


Aj? 

UNITED  STATES 

AIR  FORCE 
ACADEMY 

■  Flag  and  report  terror-related  posts 

■  Retrieve  user_  post,  user_  location  and  name  of  user 

■  Potentially  stop  terrorist  attacks  before  they  occur, 
thereby  preserving  property  and  saving  lives 


Today  I  will  blow  up  the  Air  Force  Academy. 

Entity:  Time  Intent  Entity:  Location 


THREAT! 


Integrity  -  Service  -  Excellence 
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^SCORPION 


Intelliaence  &  Education 


Scorpion  started  company  at  13 
after  hacking  incident 

Hired  other  prodigies  with  Hi-IQ 

Hired  super  nannies  with  Hi-EQ 
to  re-engineer  ourselves 

Formed  a  think  tank  as  a  home  for 
the  mentally  enabled 

Innovated  150+  products  and 
processes 


^SCORPION 


Worked  With 


US  Army  Joint  Systems  Integration  Lab 


US  Navy  Command  &  Control  System 
Largest  Mutual  Fund  $1.9  Trillion 

Largest  Electrical  Utility  Provider 

'  yA  / 

•  \v|  Largest  Insurance  Company 


Largest  CC  Company 


Largest  Casino  Group 
Largest  Healthcare 
Large  Government  Systems 


Scorpion:  The  Real  Company 
Behind  the  TV  Drama 


#1  Rated  Show 


NEW  DRAMA 


1 .  There’s  a  place  for  everyone  who  never  fit  in 

2.  Every  problem  has  a  solution 

3.  Celebrate  intelligence  before  sports 


^SCORPION 


Hr  H' 

* 'T'r 

H^iBL 

'*1,  ' 

1  1'  *  *  Mi 

Ji 

m 

f  ’ 

.-  f  . — . 

r  iti^r 

Wm  i  ^  ^ 

■V  IE  B 

rv 

M 

Enh 

ScenGen 


^SCORPION 


ScenGen  Summary 

RAF  automates  the  running  of  tests.  i 

ScenGen  automates  the  “thinking”  of  I 
tests.  ScenGen  is  an  Al  engine  that  * 
generates  all  possible  scenario 
combinations  for  a  given  App  Model 

Windows,  Linux,  Unix  &  VMs  supported 

Legacy  Systems  support 

System  of  Systems  support  (switching) 

Remote  access  support 

100%  environment  integrity 

No  local  network  access,  No  source 
code  access,  No  target  install, 

Language  agnostic 


CONNECT' 


WINNER 


Scientific  Approach 


MOni!l.l\4i 


SOI  lM  AHi:  IKSIIM. 

<  viiiiK  msiui  vn 


Unlimited  Agp!icatj.Qn§ 

Scorpion  Cyber  Vault 

National  Background  Investigation  Bureau 
CYBER  Testing 
UAS  Swarm  Warfare 


Result  I  Result  I  Result  I  Result 


ScenGen  combines  the  following  techniques: 

Forward  Tracking  general  problem  search  (GPS) 
Back  Tracking  general  problem  search  (BGPS) 

Finite  State  automaton 
Deterministic  and  Nondetermmbc 
In  a  single  recursive  algorithm 
In  raw  ANSI  C  (No  MS  Ltbranes) 

With  a  scalable  virtual  pointer  tree  structure 


Copyright  of  wvnv.ScorpionComputerServlces.com 
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Pre-Flight,  Security,  Time-to-field 


^SCORPION 


ScenGen  Mission  Planning 


ScenGen  Model  of  Afghan  network 

Replacing  the  “Chess”  ^ 
pieces  with  all  known  4  s 


^SCORPION 


Separating  a  cats  whiskers 
from  it's  hairs 


1-  Motion  =  8-73463  pixels/fpame. 

2-  Motion  =  20-6689  pixels/frame. 

3-  Motion  —  lM  .0997  pixej.s/frame  . 

4  -  Motion  =  1 3.2854  pixels/frame  - 

5  -  Motion  . 4901  prxels/f rame - 

Jf/ 

Tracking  low  resolution 


camouflaged  objects 


(  i 

n  '  tr-  ^  -  r 

Laniers  fixation  I 


I — h  I- — | 


xk 


Lens  Distortion  point 


wist  J 
ie/Frar 


SCORPION 


Irish  computer  genius  ‘Scorpion’ 
lands  AI  drone  deal  with  US  Army 


O  18  JAN  2011 


ScenGen  Unmanned  the 
Unmanned  Aerial  Vehicle 
(UUAV) 


Weekend  takeaway:  Living  to 
learn 

^  1  DAY  AGO 

New  stunning  image  of  the 
cosmos  reveals  eggcellent'  bird- 
like  galaxy 

O  1  DAY AGO 

HSE  interim  CIO  Jane  Carolan: 
‘Data  is  untapped  wealth  for 
health' 

O  1  DAY  AGO 


Irishman  with  hit  US  TV  show  based  on  his  life  to  bring 
AI  to  cutting  edge  of  tomorrow’s  battlefield. 


CYBER  VAULT 
CYBER  VISION 
CYBER  GARAGE 
RETRO  LOG 
BEHAVIOR  GUARD 


disruption 


»SCORPION 


Scorpion  Cyber  Vault  (SCV) 


Securing  the  System,  its  Confi g uration  and  the  Data 


I  Manhattan 
i  Project  , 


^SCORPION 


"  SCORPION 

l  r  COMPUTER  SERVICES 


GOV  Governance 


SG  ScenGen 
T  ester/Normalizer 


CM  Config  MoM 


AA  Access  Administration 


PROD  ENV  - 


SRC  Source  Control 


Ml  Migration 
Integrity 
thru  SOD 


Firewall 


»SCORPION 


Normalizer  Checks 

1 .  No  permissions  changes  without  corresponding  Security 
Record 

2.  No  more  than  one  VPN  location  at  a  time 

3.  No  Admin  permissions  for  non  managers 

4.  No  more  than  two  users  should  have^the  same  password 

5.  No  permissions  changes  after  5pm 

6.  No  Developer  with  access  to  more  than  one  project 

7.  No  permissions  changes  more  than  3  times  in  48hrs 

8.  No  Admin  permissions  if  hire  date  is  <  6mo 


Cyber  Vision 

We  process  visuals  60,000x  faster  than  text. 

Visual  analogies: 

•  Systems  =  Planets 

•  Security  Vuls  =  Craters 

•  Bandwidth  Usage  =  Size 

•  Communication  =  Gravity 

•  Network  =  Pipelines 

•  Data  Flow  =  Water  streams 

•  Abnormalities  =  Acne 

All  in  Oculus  Rift! 
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seas Sagas 


^SCORPION 


EMAIL  SERVER 


FIREWALL 


DATABASE  SERVER 


STORAGE  SERVER 


Imagine  if  a  CYBER  garage  was  set  up 
with  all  the  latest  cyber  technology 
components  (servers,  operating 
systems,  firewalls,  etc.)  to  train  our 
federal  government  warfighters  and 
civil  servants  on  how  best  to  attack  and 
defend  our  environment? 


Configure  and  deploy  entire 
CYBERtropolis  ranges  "on 
demand"  based  on  the  user 


Think  of  it  as  highly 
adaptable  motion  picture 
set  but  in  the  CYBER  virtual 
environment. 


Modern  systems  exist  that  can  analyze  detailed  system  logs  and  determine  if  the 
behavior  of  the  application  is  appropriate 

•  The  majority  of  government  systems  are  legacy  and  don't  have  detailed  logging 

•  Limiting  their  ability  to  take  advantage  of  this  modern  day  cyber  security 
technology. 

•  Re-writing  these  systems  would  be  cost  prohibitive 

•  Imagine  if  a  system  was  smart  enough  to  automatically  know  where  to  retro-fit 
modern  logging  code  into  legacy  systems  bridging  this  technology  gap 


Scorpion  Retro-log  is  a  system  that  addresses  this  challenge. 


SCORPION 


Behavior  Guard 


The  data  gap: 

"our  ability  to  gather  data  had  exceeded  our  ability  to  make  use  of  it 


The  Behavior  Guard  consolidates  disparate,  non-standard,  non-active 
directory,  non-integrated  admin  and  security  systems  across  platforms.  Write 
access  is  optional. 


If  you  can  see  it,  we  can  automate  it 


The  accelerating  pace  of  change ... 


.<  ■ 


Agricultural^  a.000  L  Industrial  Light 

Revolution 


inoustnai  ugni 

Revolution  bulb  ~  " 


bulb 


Moon 

'landing 


World 
Wide 
Web 


Human 
*n  — •  genome 
sequenced I 


I ...  and  exponential  growth 
in  computing  power . . . 

Computer  technology,  shown 
here  climbing  dramatically 
by  powers  of  10.  is  now 
progressing  more  each 
hour  than  It  did  In  Its 
entire  first  90  years 

■  ■I 


COMPUTER  RANKINGS 

By  cafcuwuons  per  second 
pm  SI  COG 


Analytical  engine 

Never  lolly  built. 
Charles  Babbage  s 
Invention  was 
designed  to  solve 
computational  and 
logical  problems 


A. ..will  lead 
to  the 
Singularity 


Colossus 

The  electron* 
computer.  vnth 
1,500  vacuum 
tubes,  helped  the 
British  cracV  German 
codes  during  WW II 


2045 

-  Surpasses 
brainpower 
equivalent 
to  that  of 
alt  human 
brains 
combined 


Surpasses 
brainpower 
of  human 
m  2023 


UNIVAC  I 

The  first  commer 
ciaJty  marketed 
computer,  used  to 
tabulate  the  U.S. 
Census,  occupied 
943  cu.  ft 


OCC 

POP* 


Apple  II 

At  a  price  of  $1,298 
the  compact 
machine  was  one  of 
the  first  massn^ly 
popular  personal 
computers 


1 0,000,000,000 


5ui  poises 
brainpower  of 
mouse  m  2015 


Pwrtiun 

n  pc 


O*tU0*o  J86 


wl**  3  SSfC 


-cacrnoMtCHAthCAi.  - 

- 1 - 


--ITEivrs- 


-VACUUM  TVOrs  — —  TMANSIS10KS- 


-  INTEGRATED  CIRCUITS 


1020 


1940 


I960 


IpHo 


Power  Mac  04 

The  first  personal 
computer  to  deliver 
more  than  1  billion 
floatingpoint 
operations  per 
second 
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SCORPION 


Scientific  Approach 


DODiillW 


Result 


Res  u  II  I  Resirlt  I  Result  I  Result 


Sconi^en  combines  the  following  techniques: 


Unlimited  Applications 
■  Scorpion  Cyber  Vault 

►  National  Background  Investigation  Bureau 

►  CVBER  Tasting 

-  UAS  Swarm  Warfare 


Forward  Tracking  general  prob-em  search  (GPS) 
Back  Tracking  general  problem  search  (6 GPS) 
Fwste  State  automaton 
Deteimmistlc  and  NefideLemvn.iMic 
In  a  sing  e  recursive  algorithm 
In  i lkv  ANSI  C  (No  MS  Ubrarves) 

With  a  scalable  Wllual  pOrttar  tree  structure 


Copyright  of  www.  ScorpionCemputerSsrvitc  s  .com 


Air  Force  Research  Laboratory 


AFRL  Sensing  Autonomy  Vision 

for  NDIA 


6  Mar  2018 


lOO  YEARS  OF  U.S.  AIR  FORCE 
SCIENCE  &  TECHNOLOGY 


Integrity  *  Service  *  Excellence 


Terry  Wilson,  PhD 
AFRL/RY 

Air  Force  Research  Laboratory 


RY  Autonomy  Vision 


Autonomy  Vision:  Timely  Generation  of  knowledge  to  improve  every  AF  decision 

An  autonomous  sensing  system  can  understand  any  multi-domain  mission 
environment  as  a  single  integrated  battlespace  through  a  scalable  combination 
of  peer,  task,  and  cognitive  flexibilities,  executes  mission  effects,  and  assesses 
them  in  a  timely  manner. 


Flexibility  is  the  key  to  defense  autonomy! 


The  Need  for  Change 


*  Currently  USAF  is  good  at  generating  knowledge  using  predefined  meaning 
and  specific  tasks  in  a  linear  fashion 

-  Approach  to  knowledge  generation  is  manual,  slow  and  not  scalable 

-  Only  a  small  percentage  of  the  data  is  used  to  generate  knowledge  -  limited  by  manpower 

*  Goal  of  autonomy  is  to  generate  knowledge  applicable  across  numerous 
tasks  to  break  linearity 

-  Provides  ability  to  utilize  multi-domain  knowledge  for  faster  decisions  and  actions/effects 

-  Applies  at  all  levels  of  instantiations 

*  Defense  autonomy  application  requires  flexibility 

-  Cognitive,  peer,  and  task  flexibilities 
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Sensing  Autonomy  Scenario 


Knowledge 
Generation  for 
Human-Based 
Decisions 


Inputs:  Mission 
Objectives,  ROEs,  Tasks 
Multi-Domain  Fusion 
Decision-aids  &  Human- 
Machine  Interaction 


RY  Autonomy  Research  Thrusts 


Key  Technologies 


Multi- 
Domain 
Sensing 
Sources 


Knowledge  & 
Execution 
Management 


Synthesis  for 
Understanding 


Synthesis  is  a  partial 
driver  for  sensor  design 


0 


Reactive 
autonomy  to 
proactive 
autonomy 


Predictive  & 
Prescriptive 
Analysis 
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Multi -Domain  Effects  Analysis 


Multi- 

Domain 

Effects 


•  Multi-phenomenology  level 
machine  learning 

•  Robust  knowledge 
representation  strategies 

•  Flexible  resource  management 
and  architecture  strategies 

•  Decision  &  game  theory 

•  Advanced  computing 

•  Dynamic  optimization  theory 

•  Joint  inference  and  control 

•  Multi-domain  constructive 
MS&A  tools 

•  Cognitive  EW 


5 


Thank  You 
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Are  you  building  Skyscrapers 

Or 

Dog  Houses? 
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A  Disruptive  Solution  to  the  HPC 

(Parallel  Processing)  Problem 
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Disruptive  Solution  To  HPC 
(PARALLEL  PROCESSING) 


MEASURABLE  GOALS: 

-  Provide  multiple  orders  of  magnitude  improvement 
in  application  run-time  speed; 

-  Provide  an  order  of  magnitude  reduction  in 
the  time  and  cost  to  develop  software; 

-  Allow  application  experts  to  design, 
build,  and  test  software  directly ; 

-  Allow  newcomers  to  a  project  to  quickly  learn 
and  understand  complex  software ; 


Disruptive  Solution  To  HPC 


REPRESENTATIVE  APPLICATIONS: 


-  Adaptive  Control  of  Large  Groups  of  Autonomous  Moving  Platforms 

-  Human  Body  Organ  simulation 

-  Global  Climate  prediction 

-  Fluid  Flow  simulation 

-  Biological  Particle  simulation 

-  Chemical  -  Molecular  structure  simulation 

-  Scanning,  sorting,  and  correlating  massive  databases  (Big  Data) 

-  Weather  prediction  in  mountainous  terrain 

-  Power  distribution  simulation 

-  Electro-magnetic  wave  simulation 

-  Global  HF  power  transmission 

-  Global  Military  Planning  -  Multiple  moving  platform  simulation 
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MUST  DISTINGUISH  BETWEEN  SERVERS  &  PARALLEL  PROCESSORS 


Disruptive  Solution  To  HPC 


Seven  Layer  Model  for  Computer  Technology 


APPLICATION 

REQUIREMENTS 


SOFTWARE 

REQUIREMENTS 


HARDWARE 

REQUIREMENTS 


FUNCTIONAL 

REQUIREMENTS 


OPERATIONAL 

REQUIREMENTS 


APPLICATION 
MODEL  SPACE 


SOFTWARE 

DEVELOPMENT 

ENVIRONMENT 

SYSTEM 

SOFTWARE 

ENVIRONMENT 

COMPUTER 
HARDWARE 
SPACE 


HARDWARE 

ENVIRONMENT 


Input  Data 
Output  Results 
Speed  &  Accuracy 


User  Interface 
Initialization 
Visualization 


Application  Data  Space 
Application  Algorithm  Space 


Architectural  Drawings 

Data,  Algorithmic,  &  Graphic 
Languages 


Run-Time  System 
Parallel  OS 
System  OS 


Assembly  Language 
Micro  Code 


Servers 

Parallel  Processors 


SEVEN  LAYER  MODEL  11/07/16 
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Spaces  for  Translation  of  Application 
Requirements  into  Software  &  Hardware 
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Disruptive  Solution  To  HPC 


APPLICATION 

APPLICATION 

SOFTWARE 

SOFTWARE 

SPACE 

TRANSFORMATION 

SPACE 

TRANSFORMATION 

FUNCTIONAL 

ARCHITECTURE 

SOFTWARE 

BOARD/BOX 

REQUIREMENTS 

_ _ X 

DESIGN 

_ _ x 

ARCHITECTURE 

_ _ x 

MAPPING 

OPERATIONAL 

ALGORITHM 

SOFTWARE 

PROCESSOR/CHIP 

REQUIREMENTS 

DESIGN 

LANGUAGE 

MAPPING 

HARDWARE 

SPACE 


BOXES/ 

BOARDS 


CHIPS/ 

PROCESSORS 


SOFTWARE SPACES  03/18/17 


Spaces  for  Translation  of  Application 
Requirements  into  Software  &  Hardware 
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MODEL  SPACE  HIERARCHY 


ENVIRONMENTS 

GEOGRAPHIC 

ATMOSPHERIC 

IONOSPHERIC 

ELECTRO¬ 

MAGNETIC 

ACOUSTIC 

WATER 

SURFACE 

WATER 

SUBSURFACE 

OTHER 

C2 

DECISON 

MODELS 


PLATFORMS 

GROUND 

STATIONS 

GROUND 

VEHICLES 

AIRCRAFT  / 
HOVERCRAFT 

SPACECRAFT 

SATELLITES 

UAVS  / 
MISSILES 

SURFACE 

VESSELS 

SUBSURFACE 

VESSELS 

6  DOF 
MOVEMENT 
MODELS 


EQUIPMENT/ETC. 

SENSORS 

WEAPONS 

COMM 

SYSTEMS 

HOST 

COMPUTERS 

CONTROL 

SYSTEMS 

EW 

SYSTEMS 

NAVIGATION 

SYSTEMS 

POWER 

SYSTEMS 

ModelHierarchy  01/24/11 
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Disruptive  Solution  To  HPC 


APPLICATION  EXPERTS  USE 


CAD  GUI 

Engineering  Drawings 
Natural  Language 
Large  Libraries 


Graphical  User  Interface 
Large  Geographic  Libraries 
Interactive  Facilities 


INHERENT 

PARALLELISM 


DESIGN 


CAD  ARCHITECTURE 
THREE  LANGUAGES 


RESULTS 


APPLICATION 
SYSTEM 
TO  BE 

DEVELOPED 


SUBSYS 

1 


SUBSYS 

2 


SUBSYS 

M 


SUBSYS 

N 


VISUAL 

DEVELOPMENT 

ENVIRONMENT 


MODULE 

MODULE 

1 

2 

i 

MODULE 

MODULE 

M 

N 

RUN  -TIME 
SYSTEM  (RTS) 


VisiSoft 
PARALLEL 
OPERATING 
SYSTEM  (VPOS) 


USER  OS 


it 


PARALLEL  PCs 

-  72  Processors 
- 1000  GIG  each 
Semiconductor 
Memory 


INDEPENDENT 

APPLICATION 

SUBSYSTEMS 


DESIGN 
ARCHITECTURE 
& 

PRODUCE 
CODE 


INDEPENDENT 

MODULES 


VisiSoft  CAD  System  02/20/17 


HARDWARE 


SOFTWARE-HARDWARE  RUN-TIME  ENVIRONMENT 


Visual  Software  Engineering  Using  A  CAD 
System  For  Building  Complex  Software 
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Disruptive  Solution  To  HPC 


RESOURCE:  TRANSCEIVER 

INSTANCES :  TRANSMITTER 

RECEIVER 

GENERAL  PARAMETERS 

1  TRANSMITTER  POWER 

REAL 

INITIAL  VALUE  100 

1  RECEIVER  THRESHOLD 

REAL 

INITIAL  VALUE  120 

RADIO 

1  TRANSCEIVER 

STATUS 

TRANSMITTING 

RECEIVING 

IDLE 

OFF 

1  LOCATION 

2  X  POSITION 

REAL 

2  Y  POSITION 

REAL 

2  ELEVATION 

REAL 

1  ANTENNA  HEIGHT 

REAL 

1  ANTENNA  GAIN 

REAL 

RECEIVER  CONNECTIVITY  VECTOR 

1  POWER  AT  RECEIVER 

REAL 

1  TOTAL  NOISE  POWER 

REAL 

1  CONNECTIVITY  MATRIX 

2  PROPAGATION  LOSSES 

3  TERRAIN  LOSS 

REAL 

3  FOLIAGE  LOSS 

REAL 

3  TOTAL  LOSS 

REAL 

2  SIGNAL  POWER 

REAL 

2  SIGNAL  TO  NOISE  RATIO 

REAL 

2  LINK  DELAY 

REAL 

2  LINK 

STATUS 

GOOD 

FAIR 

POOR 

TRANSCEIVER  RULES 

1  TRANSCEIVER  PROCESS 

RULES 

GOOD  RECEPTION 

CONFLICTING  RECEPTION 

CONFLICTING  BROADCAST 

A  Space  -  Data  Structure  (a  RESOURCE) 
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Disruptive  Solution  To  HPC 

PROCESS:  RECEPTION  RESOURCES:  TRANSCEIVER 

INSTANCES:  TRANSMITTER  ME  S  S  AGE_F  ORMAT  S 

RECEIVER  TRANSMITTER  OUTPUT 


START_RECE PTION 

IF  TRANSCEIVER  IS  IDLE 

EXECUTE  GOOD__RECE PTION 
ELSE  IF  TRANSCEIVER  IS  RECEIVING 
EXECUTE  CONFLICTING_RECE PTION 
ELSE  IF  TRANSCEIVER  IS  TRANSMITTING 
EXECUTE  C ONFL I CTI NG_BROADCAS T  . 

GO OD_RECE PTION 

IF  S I GNAL_TO_NOI SE_RATI O  IS  GREATER  THAN  RECEI VER_THRE SHOLD 
SET  TRANSCEIVER  TO  RECEIVING 

ADD  S I GNAL_PO WER  TO  TOTAL  POWER_AT_RECEIVER  . 

CALL  DECODE_ME  SSAGE  . 

IF  MESSAGE  TYPE  IS  FORMAT_A 

AND  SYNC_CODE  IS  VALID 

AND  LAST_SYMBOL  IS  A  TERMINATOR 

EXECUTE  SEND_ACKNOWLEDGEMENT  . 

CONFLI CTING_RE  CEPTION 

IF  P OWER_AT_RE CE I VE R  IS  GREATER  THAN  SIGNAL_POWER 
SCHEDULE  ABORT_RECEIVE  NOW  . 

CONFLI CTING_BROAD CAST 

CANCEL  E ND_RE CE I VE  NOW 

SCHEDULE  S TART_RE CE I VE  IN  EXPON(0.83)  MILLISECONDS 
WITH  PRIORITY  80 

SEND_ACKNOWLEDGEMENT 

MOVE  ACKNOWLEDGEMENT  TO  T RAN S MI T_ME S SAGE_BUFFER 
IF  DESTINATION  IS  BROADCAST 

SEARCH  LINK_CONNECTIVITY_VECTOR  OVER  RECEIVER 
EXECUTING  TRANSMISSION 
WHEN  LINK  IS  GOOD 
ELSE  EXECUTE  TRANSMISSION  . 

TRANSMISSION 

SCHEDULE  LINK_RECE PTION 

IN  LINK_DELAY  MICROSECONDS 

USING  TRANSMITTER,  RECEIVER 


A  Transformation  -  Rule  Structure  (a  PROCESS) 
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Disruptive  Solution  To  HPC 


Spaces  for  Translation  of  Application 
Requirements  into  Software  &  Hardware 


Connecting  Resources  &  Processes  to 
Create  a  Sequence  of  Transformations 
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Disruptive  Solution  To  HPC 


PROPAGATION  PREDICTION 


FP>PS  JiANScEft 


1 


i  I  > 


»■ 


(»J 

PRQPRGPT I GN 


L0NCLEY.R1CE 


/  ) 

f  uwvTcr 


gE) 


LUNiJLLY_Pii;LJJULITlES 


/  iiwtijn.  \ 
[  MVKttta  ) 


IRPb.G(JLRRl  I V 


(  iJrrirfcr  ) 


/  rrn.  \  f  "Wtrt.  \ 

I  D*J_  I -  "P»*»  — {  D»X. 

'■ .  J  l\  —  J 


f  rwfl  "N 
r  «wijh  i 


RD1FF 


(J~U 


/'  «*■«. 
i  mrsmer 


X 


f  "it*  \ 
r  uMk’tvcr  J 


OLOS 


«M«W 


^  nrnr  lcr  ] 


-CMj 


f  ««n  \ 

uouvncr  | 


/  \  /'  \ 

■  nivu  l  (  uw  j 

^  J  BSCRT  ^ 


± 


/  noa.  A 

INTr«PNCf  i 


/  iww  ) 


f  KLSNfcL 


FPPS  08/26/07 


Create  a  Hierarchy  of  Software  Modules 


15 


Disruptive  Solution  To  HPC 


^JxJ 

^l*jxj 


PROP AGAT ION_MODEL 

|  XF  USER_DATA_STATUS  IS  NOT  INITIALIZED 
MOVE  USERDATINTERFACE  TO  USER_DATA 
EXECUTE  FOLIAGE_HEIGHT_INPUT  . 

IF  S YS T EM_ACT ION  IS  PROPAGAT ION_CALC 
OR  SYSTEM_ACTION  IS  EQUAL  TO  LOS 
EXECUTE  COMP UTESECT ION 
ELSE 

IF  SYSTEMACTION  IS  RECOMPUTE 
EXECUTE  RECOMPUTE _ SECTION 

IF  ERRORCODE  IS  NOT  DETECTED 
AND  RE PORTS ELECT ION  IS  OPEN 

CAT!  PROP  REPORT  MANAGER 


FOLIAGE _ HE IGHTINPDT 

IF  PROCESSFOLIAGEFLAG  IS  SET 

MOVE  USERDATINTERFACE  AVERBUILDINGHEIGHT 
TO  FOLIAGEHEIGHT  . 

COMP UTESECT ION 

CALL  VALIDATEPROPINPUTS 
IF  ERRORCODE  IS  DETECTED 
EXIT  THIS  RULE  . 

EXECUTE  COMPUTE _ COORDINATES 

EXECUTE  COMPUTE_ANTE NN A_HE IGHT S 
EXECUTE  CALCULATEFREESPACELOSS 
EXECUTE  BUILDTERRAINPROFILE 

It  PATH_PROFILE_ONLY_FLAG  IS  SET 
EXIT  THIS  RULE. 

CALL  TERRAIN  IRREGULARITY 
It  PKOCLSS_FOLlAGE_FLAG  IS  SET 

EXECUTE  INVOKEFOLIAGEMODEL  . 

EXECUTE  CALCEFFANT  HEIGHTS 
EXECUTE  I N V OKE_T E RRAI N_MODE  L 

EXC'E  S  S_P  ATH_LOS  S  =  EXCESSP  ATH_LOSS  +  FOLIAGE_LOSS 

RE  COMP  UT  E_S  ECT ION 

EXECUTE  C ALCULATE_FRE E SPACE _LO S S 
IF  PROCESS_FOLIAGE_FLAG  IS  SET 
EXECUTE  IHVOKE_FOLIAGE_MODEL 

EXECUTE  INVOKE  TERRAIN  MODEL 
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SYSTEM  ACTION 

CHAR 

1 

; 

ALIAS  VALID  SYSTEM  ACTION 

VALUE 

'C'  , 

R  '  , 

ALIAS  INITIALIZATION 

VALUE 

6 

ALIAS  TRANSFORMATION 

VALUE 

•X’  , 

Y' 

7 

ALIAS  PROPAGATION  CALC 

VALUE 

'C\ 

R  '  , 

3 

ALIAS  REPORT 

VALUE 

*TT 

ID 

2 

ALGORITHM_CIIO  ICE 

INTEGER 

11 

ALIAS  VALID  ALG  CHOICE 

VALUE 

6,7,8 

1,9 

12 

ALIAS  GET  ELEVATION 

VALUE 

1 

13 

2 

PATU  PROFILE  ONLY  FLAG 

CHAR 

1 

14 

ALIAS  SET 

VALUE 

»YT 

15 

2 

LUS  ONLY  FLAG 

CHAR 

1 

16 

ALIAS  SET 

VALUE 

’YT 

17 

2 

PROCESS  FOLIAGE  FLAG 

CHAR 

1 

13 

Al  IAS  SKI 

VALUE 

•Y’ 

13 

2 

REPORT  SELECTION 

CHAR 

1 

2D 

ALIAS  VALID  RPT  SELECTION 

VALUE 

•F’  , 

S  '  , 

21 

ALIAS  OPEN 

VALUE 

*F’  , 

S  • 

22 

Al  IAS  FULL 

VALUE 

»FT 

23 

ALIAS  SUMMARY 

VALUE 

•S’ 

24 

2 

PAD 

CHAR 

04 

25 

26 

1  COORDINATE  SYSTEM 

CHAR 

1 

27 

ALIAS  VALID  COORD  SELECTION 

VALUE 

»IT  ,  ' 

M'  , 

23 

AT  TAS  T, ATT, ON 

VALUE 

•L’ 

23 

ALIAS  MGRS 

VALUE 

•M’ 

3D 

ALIAS  INTERNAL 

VALUE 

•I’ 

31 

32 

1  XMTR  POSITION 

33 

2 

XMTR  REL  POSITION 

34 

3  XMTRRELX 

REAL 

35 

3  XMTR  REL  Y 

REAL 

36 

3  XMTR  REL  Z 

REAL 

37 

2 

XMTR  MGR  POS IT ION 

CHAR 

15 

33 

2 

XMTR  GEO  POSITION 

33 

3  XMTR  LAT 

REAL 

4D 

3  XMTRJLON 

REAL 

41 

2 

XMTR  ANTENNA  HEIGHT 

REAL 

42 

2 

XMTR  ANTENNA  REFERENCE 

CHAR 

1 

43 

ALIAS  VALID_REFERENCE 

VALUE 

'S’, 

rG  * 

44 

ALIAS  SEA 

VALUE 

'S  T 

45 

ALIAS  GROUND 

VALUE 

*GT 

46 

47 

1  RCVR  POSITION 

43 

2 

RCVR  REL  POSITION 

43 

3  KL’VK  KEL  X 

REAL 

5D 

3  RCVR  REL  Y 

REAL 

51 

3  RCVR  REL  Z 

REAL 

52 

2 

RCVR  MGR  POSITION 

CHAR 

15 

53 

2 

RCVR  GEO  POSITION 

54 

3  RCVRLAT 

REAL 

55 

3  RCVR  I, ON 

REAL 

56 

2 

RCVR  ANTENNA  HEIGHT 

REAL 

57 

2 

RCVR  ANTENNA  REFERENCE 

CHAR 

1 

ll— 
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Double  Click  To  Edit  The  Code 
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Disruptive  Solution  To  HPC 

TYPES  OF  MODULES 


TASK 


IND  MODULE 


HIERARCHICAL  MODULE 


ELEMENTARY  MODULE 


B) 


UTILITY  MODULE 


MODULE  COLORS  09/30/17 


LIBRARY  MODULE 
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Disruptive  Solution  To  HPC 


TYPES  OF 
RESOURCES 


SHARE D _ 

RESOURCE 


S  HARE  D_ 
ALIAS 


SHARED  BETWEEN  PROCESSES 


SHARED  BETWEEN  MODULES 
UTILITIES  &  LIBRARIES 


LOCAL _ 

INTERTASK 


SHARED  BETWEEN 
FAMILIES  OF  TASKS 


GLOBAL_ 

INTERTASK 


SHARED  BETWEEN 
GLOBAL  TASKS 


INTER_ 

PROCESSOR 


SHARED  BETWEEN  PROCESSORS 


IP 


acces s  ACCESS  TO  IP  RESOURCES 


PANEL  \ 

RESOURCE  SHARED  WITH  PANELS 


FILE  NAME 
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Air  &  Ground  Platforms  connected 
to  Satellite  Networks  &  GPS 
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Disruptive  Solution  To  HPC 


- 


Must  be  able  to  create  complex  scenarios  -  fast! 


Disruptive  Solution  To  HPC 


JD* 


005  004 
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If  you  use  QJiSiSo/fi  to  build  complex 

Real-Time  Control  Systems  &  Simulations 

on  Parallel  Processors 
you  can  save  many  orders  of  magnitude 

of  time  and  money! 
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SINGLE  PROCESSOR  SPEED  COMPARISONS 

-  GAIN  100F  X  SPEED  WITH  VISISOFT  PRINCIPLES 
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GO  FROM  100  RACKS  TO  1  RACK 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

2 

3 

4 

5 

6 

7 

8 

9 

Blue  Gene  VS  Green  Gene  05/14/1 5 

10 

^ _ _ J 

V 

The  IBM  Blue  Gene  -  Using  Standard  Languages  -  100  Racks  -  1,638,400  Processors 

5,000  Sq  Ft.  -  8,000  KW 


Versus 

The  Green  Gene  Machine  -  Using  VisiSoft  -  1  Rack  -  2300  Processors 

16  Sq  Ft.  -  32  KW 
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What  does  that  do  to 

memory  boundary  crossing  delays? 

What  about  1  to  2  additional 

orders  of  magnitude? 
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It  doesn’t  stop  there! 

We  can  shrink  it  more 

with  our  architectural  drawings  of  software! 

What  about  a  total  of  4  to  6 

orders  of  magnitude? 

Know  what  that  does  to  energy  utilization? 
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And,  it  doesn’t  stop  there! 

We  can  shrink  it  even  more  -  using  our 
hierarchical  data  structures  to  support 
fast  heterogeneous  models  (time  &  space). 

What  about  a  total  of  6  to  8 

orders  of  magnitude*  ? 

Know  what  that  does  to  the  computer  field? 
*Depends  on  the  application 
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It  still  doesn’t  stop  there! 

We  can  make  it  even  faster! 

Separate  Parallel  Processor  design 
from  Server  design. 

Get  rid  of  DMA  Channel  Comm-Routing 

And  use  Direct  Memory  Access 
between  PC  boxes. 
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And  still  -  not  finally, 

Use  VPOS  -  a  tailored 
Parallel  Processing  OS. 

And  get  rid  of  big  time  wasters,  e.g.: 

-  Cache  Coherency 

-  Thread  Synchronization 

-  Stacks 

-  Etc. 
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Improving  Speed  to  get  Accuracy 


REVIEW  OF  HOW  THIS  LEVEL  OF  SPEED  IS  ACHIEVED 


•  VisiSoft  SINGLE  PROCESSOR  SPEEDS  vs  C+\  Fortran 

-  Gain  2+  Orders  of  magnitude  (already  tested) 

•  CAN  MATCH  100  RACKS  WITH  1  RACK 

-  Gain  2+  Orders  of  magnitude  (obvious  distances/comm) 

•  VisiSoft  PARALLEL  PROCESSOR  SPEEDS 

-  Gain  »  2  Orders  of  magnitude  (includes  PUE  -  already  tested) 

•  USE  HETEROGENEOUS  CELL  SIZES 

-  Gain  « 1  Order  of  magnitude  (already  tested) 

•  USE  HETEROGENEOUS  TIME  STEPS 

-  Gain  « 1  Order  of  magnitude  (already  tested) 

VisiSoft  -  CAN  BEAT  REAL  SPEED  REQUIREMENTS  BY 
-  6  TO  8  ORDERS  OF  MAGNITIDE  -  ON  PARALLEL  PROCESSORS 
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PREDICTION  SYSTEMS,  INC. 

Visual  Software  International 

309  Morris  Ave  Suite  J) 

Spring  Lake,  NJ]  07762 

Telephone:  (732)  449-6800 
Fax:  (732)449-0897 

Web  Sites:  www.VisiSoft.com 
www.predictsys.com 

E-Mail  VSI@VisiSoft.com 
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Disruptive  Solution  To  HPC 


QUESTIONS 


Functional  Monitoring  &  Diagnosis  (FMD) 


John  J  Kelly,  PhD 
Model  Software  Corporation 
www.ModelSoftware.com 


©Model  Software 


Vision 


Monitor  and  diagnose  any  plant  in  real  time  based  on  an  operational  model  of 
the  plant 

Trans’ircismm  fin« 


—  Cooling  tower 


Nutletir  fuel 


fruiting 


Control  rods 


Third  loop 


Condenser 


first  loop  - 


Pressurized  Water  Reactor 


©Model  Software 


Simplified  Example:  System  &  Model 


Power  =  Voltage  *  Current 
Voltage  =  Current  *Resistance 
Resistance  =  {if  S=closed,  R1 } 

{if  S=open,  -infinite} 
R1  =  {if  bulb=nominal,  1  ohm} 
Voltage  =  {if  battery=nominal,  1 .5  volts} 
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Measured  Value 


Real-time  Detection  of  Failure 


•  Using  an  operating  model  enables  detecting  failures  earlier  than  they  might 
otherwise  be  detected,  affording  more  time  to  manage  them 
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Combinatorial  Space  of  Symptoms 


Failure  Modes 


*  Defined  symptom-fault  relation 
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Existing  Technologies:  Empirical 


•  Goodness  of  Fit  (Overfitting) 

-  Curve-fitting  tools  are  notorious  for  fitting  high-order  polynomials  to  low-order 
phenomenon,  such  as  for  log  and  square-root  functions,  or  even  just  simple  linear 
equations  that  are  slightly  obscured  by  noise. 

-  While  by  adding  enough  high-order  terms,  there  can  eventually  be  a  fit,  to  some 
criteria,  within  the  data  domain  of  the  exemplars,  but  as  soon  as  the  equations  are 
used  outside  the  range  of  the  training  exemplars  the  fit  can  be  extremely  bad 
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Technique  Summary 


Handcode 

Empirical 

Models 

Availability  of 

Expert/Model 

Data 

Model 

Goodness  of  Fit 

Varies 

Overfit 

As  good  as  it  gets 

Combinatorics 

Limited 

Limited 

Virtually  unlimited 

Reliability 

Good 

Limited 

Best 

Range  of 

Considered 

Scenarios  in 

Limited  only  by  #  of 

Scenarios 

scenarios 

exemplar  set 

elements  in  Model 
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Technicians  &  Engineers 


•  The  empirical  techniques  are  comparable  to  using  technicians  to  diagnose 
equipment 

-  Most  all  the  time  the  technician  immediately  knows  what  is  wrong  -  because  he 
has  seen  it  before  in  actual  practice  or  in  training 

-  The  balance  of  the  time  the  technician  struggles  because  he  doesn’t  know  how  to 
diagnose  from  first  principles 

•  An  engineer  can  diagnose  anything  if  he  has  a  schematic  and  some  time 

-  He  is  well- versed  in  the  first  principles  and  in  reasoning  about  models 

•  The  downside  to  using  engineers  is  that  they  must  be  kept  on  call  and  they  do 
require  some  time  to  think  about  the  problem 

•  FMD  software  performs  essentially  the  same  analysis  that  an  engineer  would 
perform 

-  But  it  is  practical  to  keep  the  FMD  software  online  24/7 

-  It  is  able  to  perform  the  analysis  in  less  than  a  second 
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Autonomous  Vehicle  Simulation  (MDAS.ai) 


Sridhar  Lakshmanan 

Department  of  Electrical  &  Computer  Engineering 
University  of  Michigan  -  Dearborn 


Presentation  for  Physical  Systems  Replication  Panel  - 
NDIA  Cyber-Enabled  Emerging  Technologies  Symposium 


M 
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Core  Areas  of  Expertise 


DEARBORN 


Key  words  Faculty  Involved 


Perception 

Big  Data 

Machine  learning 

Bayesian  Inference 

Sensor  fusion 

Sridhar  Lakshmanan 

Yi  Lu  Murphey 

Paul  Watta 

Intelligent  Control 

O 

.  .  .  ,  Stan  Baek 

Autonomous  vehicles  w  „ 

UAV  U  heng 

.  ,  ,  Samir  Rawashdeh 

Industrial  robots  .... 

Michael  Putty 

1 — 

— J  Vehicle  Communications 

< 

v2v 

v2i 

v2p 

Paul  Richardson 

Weidong  Xiang 

Chun-Hung  Liu 

SAE  On-Road  Automated  Vehicle  Systems  (J3016)  /  Functional  Safety  (ISO  26262)  Steve  Underwood 

RVSWG  20  light  and  medium  trucks  standard  Mark  Zachos 

Cybersecurity 

Fingerprinting  ECU's  Hafiz  Malik 

IDS  Di  Ma  m 

Solid  state  convertors  Ba'  — | 

Power  Electronics  Electric  drives  aggie  a^g  ^0 

rharalno  Taehyung  Kim 

Chargmg  Wencong  Su  O 

Sensors  &  Chips 

Chip  Design  /  SOC 

Nano  technology 

Solid  state  optics 

Riadul  Islam 

Alex  Yi  (/) 

Autonomous  Navigation:  Army  ATD 


Miniature  Robots:  Army  SBIR 


Lane  Detection:  Army 


Sridhar  Lakshmanan 

Ph.D.  Electrical  &  Computer  Eng.  (UMass-Amherst) 

Associate  Professor 
University  of  Michigan-Dearborn 
Office:  SFC  212 
313.593.5516(0) 
734.646.8920  (M) 
lakshman®  umich.edu 
linkedin.com/in/slakshmanan 
researchqate.net/profile/Sridhar  Lakshmanan 

http://www.MDAS.ai 


Sensor  Fusion:  DARPA 


Pedestrian  Detection:  Ford  URP 


,  , — i 


Preprocessing  ^ 

Foreground 

Segmentation 

Object 

Classification 

Verification  / 
Refinement 

Trucking 

Application 

-  j 

77 

77 

77 

77 

lll3 

W1  W1  W1 


camera  pose  regions  of  interest  labeled  ROIs  verified  and  refined  speed  direction,  etc. 

(RQh)  ROIs 


MDAS:  Michigan  Dearborn  Autonomous  Shuttle 


http://www.MDAS.ai 


Goal: 

Travel  a  predefined  loop 
picking  up  or  dropping 
off  people  at  each  stop 
by  Fall  2018 


Capabilities 

S  Safe:  Keep  the  occupants  of  the  shuttle  as 
well  as  those  encountering  it  secure  at  all 
times 

S  Useful:  Navigate  a  predefined  loop  picking 
up  or  dropping  off  people  at  each  stop 

S  Intelligent:  Identify  and  avoid  various 
types  of  stationary  and  moving  obstacles 

S  Robust:  Operate  in  all  weather  and 
lighting  conditions 

S  Stop  immediately  when  in  an  emergency 


Emergency 

vehicles 


Platform 

S  Polaris  GEM  E6 

■  NHTSA-certified  LSV 
S  Drive-by-wire  modified 

■  Steering/Throttle/Brake/Reverse 
Turn  signal/Hazard  lights 

Differentiators 

■  Technology  build-up  includes  vehicle 
AND  infrastructure 

■  "Second  World"  deployment  scenario: 
Focus  on  low-speed,  stop-and-go, 
pedestrian-rich  environment 


S  Design,  Build  &  Test 
S  Why  simulate? 

>  Bring  data  back 

>  Requirements 

>  Failure  modes 
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MDAS.ai  Timeline  &  Ecosystem 


Deep  learning:  Nvidia  GPU 


May '19: 
AutoSens-D 


Fall  '19:  v2.0  Shuttle 
(Loop) 


Field  of  view  —  Sensor  frame 
—  Map  frame 

Localization 

>  Sub-cm  accuracy 

>  GPS+ 


Dec  '18:  vl.O  Shuttle 
(Straightaway) 


High-fidelity  simulation 


Aug  '18:  UMD- 
MEDC  Showcase 


Drive-by-wire  conversion 

>  Power-assisted  steer 

>  Linear  brake 

>  Analog  throttle 


April  '18:  Ml 
Robotics  Day 


Mobility  Model 


Multi-Disciplinary  Project 


M 
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Bicycles 


Road  split 

j  i  c 
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1  MDAS:  Michigan  Dearborn  Autonomous  Shuttle 

1  httn://  www.  MDAS.ai 

1  Goal: 

r 

1  Travel  a  predefined  loop 

W  \  \- 

1  picking  up  or  dropping 

1  off  people  at  each  stop 

>  1  by  Fall  2018 

Capabilities 

v'  Safe:  Keep  the  occupants  of  the  shuttle  as 
well  as  those  encountering  it  secure  at  all 
times 

v''  Useful:  Navigate  a  predefined  loop  picking  | 
up  or  dropping  off  people  at  each  stop 
Intelligent:  Identify  and  avoid  various 
types  of  stationary  and  moving  obstacles 
Robust:  Operate  in  all  weather  and 
lighting  conditions 

S  Stop  immediately  when  in  an  emergency 


Physical  System 


Emergency 

vehicles 


A  4  Construction  zones 


* 


Motorcycles 


o 


Platform 

✓  Polaris  GEM  E6 

-  NHTSA-certified  LSV 
S  Drive-by-wire  modified 

■  Steering/Throttle/Brake/Reverse 
Turn  signal/Hazard  lights 

Differentiators 

■  Technology  build-up  includes  vehicle 
AND  infrastructure 

■  "Second  World"  deployment  scenario: 

Focus  on  low-speed,  stop-and-go, 
pedestrian-rich  environment  [ 


Capabilities 

>  Campus  mobility  model  is  Physics-based  and  not  based  on  empirical  data  (see  next  sheet) 

>  Special  case  of  the  Next-Generation  NATO  Reference  Mobility  Model  (NG-NRMM) 

>  Computer  model  is  validated  by  real  data  from  the  physical  shuttle  MDAS.ai,  and  conversely, 
computer  model  is  used  to  improve  on-road  performance  of  the  vehicle 

>  Model  output  is  performance  metrics  such  as  -  Mobility,  Traversa bility.  Repeatability,  Reliability 

>  Model  used  to: 

S  Assess  and  compare  autonomous  systems  in  campus/urban  environments 
S  Compare  autonomous  systems  to  baseline  human-driven  systems 
S  Benchmark  progression  of  autonomous  systems  from  Level-0  to  Level-5 
•S  Assess  performance  of  Perception  Systems  and  Control  Strategies 


Performance  Metrics 
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^SCORPION 


Vendors 

:omponent| 


Systems  Vault  (SVN) 


Delta/Patch  Migrations 
Multiple  Gold  Masters  1,2,3 


/  Production 


Parallel  Migration/Rollback 


r  Site  ^ 
Gold  Master 


r  Site  ^ 
Gold  Master 


Site  ^ 
Gold  Master 


Site  ^ 
Gold  Master 


r  Site  Site  ^ 

Gold  Master  A  Gold  Master 


Configuration  Monitor  (OACC) 


Systems  Monitor  (DDMA/DDMi) 


SCORPION 


DevTest 

Training, 

1HT/V 

UAT/Demo  ] 

1  Other...  il 

